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I. A BRIEF BIBLIOGRAPHY OF TESTS 
IN HIGH-SCHOOL SUBJECTS 

In the October number of the School Review an article described the 
work of a committee on results in the University of Chicago High School. 
Reference was made in this article to the bibliographies worked out by the 
various departments. A number of requests for them have since come to 
the chairman of the committee, and it was decided to publish these bibliog- 
raphies in order to make them available to the readers of the School Review. 
They supplement and bring up to date the bibliographies given in the Seven- 
teenth Yearbook of the National Society for the Study of Education, Part II, 
and in the announcement of the Bureau of Educational Research, University 
of Illinois, 1918-19. 

MATERIAL ON TESTING IN HIGH-SCHOOL LATIN 

H. F. Scott 

The Henmon tests. — The amount of published material relative to testing 
in Latin is not large. Perhaps the most carefully constructed tests now 
available for the purpose of measuring the results of high-school Latin are 
those of Professor V. A. C. Henmon, of the Department of Education of the 
University of Wisconsin. These tests and the method followed in their 
preparation are described in full in "The Measurement of Ability in Latin," 
Journal of Educational Psychology, VIII (November and December, 1917), 
515-38, 589-99. They consist of two main parts, the first dealing with 
vocabulary, the second with translation. 

First, a tentative vocabulary test was prepared by selecting fifty Latin 
words and fifty English words which were found in the exercises of four 
widely used first-year Latin books. These were given to 252 pupils in ten 
different schools, and the results carefully scored for the purpose of determin- 
ing the relative difficulty of the words. A second vocabulary was then made 
up by taking the words which were common to thirteen beginners' books of 
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wide use and of recent date, the number of such words amounting to 319. 
From this list all words not occurring in each of the three authors, Caesar, 
Cicero, and Vergil were dropped, reducing the total to 239. The vocabulary 
thus selected was given as a test in nineteen schools located in three different 
states. In a study of the results, the words were scored with relation to the 
frequency of error, and a scale value determined for each. A number of 
words were found to be unsatisfactory, either because they were difficult 
to score, or because the form suggested an English meaning, or because they 
were so easy as not to be missed at all by third- and fourth-year pupils. 
These words, amounting to thirty-nine, were rejected from the original list 
and the remaining 200 were arranged in four groups giving almost exactly 
the same total for the sum of the scale values of each group. These four 
lists, or any one of them, appear to furnish a satisfactory basis for testing 
a pupil's knowledge of vocabulary at the end of the first year or any time 
thereafter. 

For the purpose of measuring the ability of pupils to translate, two lists 
of Latin sentences were prepared which employed only words found in the 
list of 239 words described above. The first test thus arranged consisted of 
thirty sentences. When these were given to the pupils of seventeen schools, 
the results proved that there were too few easy sentences for first-year pupils. 
A second list of fourteen easier sentences was then prepared, but even this 
was found to contain too few sentences sufficiently easy to serve fully the 
desired purpose. From these two lists there were selected two groups of ten 
sentences, each having almost exactly the same total of scale values, arranged 
in the order of their difficulty. A third group was formed in which all of 
the ten sentences included had approximately the same scale value. Pro- 
fessor Henmon does not regard the results as entirely satisfactory for the 
reason that the sentences of the third group are more difficult for first-year 
pupils than is desired. The method of preparation, however, seems to be 
sound, and the tests are of value. 

The Hanus tests. — Another set of carefully prepared tests is described by 
Professor Paul Hanus of Harvard University in "Measuring Progress in 
Learning Latin," School Review, XXIV (May, 1916), 342-51. Their purpose 
as stated by Professor Hanus is "to measure the growth in power in three 
elements of Latin assumed to be fundamental — vocabulary, translation, 
and grammar — and also to ascertain what correlations exist between these 
phases of growth." 

Four vocabulary lists of fifty words each were arranged, no word in 
which occurs less than one hundred times in Caesar and Cicero. In the use 
of the test as described by Professor Hanus, equal values were assumed for 
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all the words. A scale of values based on the frequency of occurrence was 
given, but no attempt was made to score the results on this basis. 

The translation test comprises ten sentences of moderate difficulty to 
which values were assigned on the judgment of those who prepared the test. 
No construction is employed which occurs less than five hundred times in 
Caesar and Cicero. The method by which the vocabulary for the sentences 
was chosen is not described, and it is not made clear by examining them. 
Some words are used which do not occur in the two hundred words of the 
vocabulary previously described. 

Ten questions in grammar are given, based on the sentences for transla- 
tion, five dealing with case and five with mood. 

While the method of organization is not so exact in these tests as in those 
prepared under the direction of Professor Henmon, they' may, on the whole, 
be found to have considerable value as a standard of measure. 

A form test. — A Latin Form Test for High Schools, prepared as a Master's 
thesis in the School of Education of the University of North Carolina by 
Lawrence J. Lohr, Jr., is described in the High School Journal (Chapel Hill, 
North Carolina) for November and December, 1918. The test is based 
upon a detailed study of the relative prominence given to the various topics 
in sixteen first-year Latin books. For example, Mr. Lohr found that an 
average of 1 lessons was given to the comparison of adjectives, and 4.4 
lessons given to the passive voice. To this study of first-year Latin books 
was added a study of selected portions of each year's reading, for example, 
the first book of Caesar, with a view to finding out how many times the 
different tenses occur, the relative number of singulars and plurals, and the 
like. Furthermore, the words selected to illustrate these forms were chosen 
on the basis of frequency of occurrence in high-school reading as shown in 
Lodge's The Vocabulary of High-School Latin. The test consists of a list 
of thirty-five unambiguous forms — nouns, pronouns, and verbs. The case, 
number, voice, tense, etc., are to be checked in appropriate columns arranged 
at the right of the list. What is tested, therefore, is simply knowledge of 
inflexional forms without any reference to syntax or word meaning. No 
report of the results obtained by the use of these tests is at present available. 

The Starch tests. — Two sets of tests printed in leaflet form for use in 
schools have been issued by Professor Daniel Starch of the University of 
Wisconsin. The first contains a vocabulary of one hundred words which 
appear to have been chosen by taking every word occurring in a Latin dic- 
ionary at a regular interval. The English equivalents, printed in different 
order from the Latin words, are given on the same page. A set of sentences, 
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ranging from the simplest form of a familiar verb to a passage consisting of 
two lines from Vergil, is also given. 

The second test, prepared by Professor Starch and Mr. J. W. Watters, 
contains a vocabulary of one hundred words, made up by choosing every 
twentieth word from Lodge's The Vocabulary of High-School Latin. Trans- 
lation tests are given for each of the four years of the high-school course, 
prepared as follows: For the first-year test, twenty sentences were selected 
by taking four sentences at equal distances apart in each of five widely used 
first-year textbooks. For the second year, seven sentences were chosen at 
intervals of twenty-two chapters in the first four books of Caesar's Gallic 
War. For the third year, seven sentences were taken at uniform intervals 
from Cicero, one from each of the orations against Catiline, one from the 
Archias, and two from the Manilian Law. For the fourth year, ten sentences 
were taken from the first six books of Vergil at intervals of five hundred lines. 

Since the range of variation in the material read in different schools is 
rather wide, the results from such a set of tests are quite uncertain. As to 
the first-year test, obviously a school using some other text than any of the 
five employed by Professor Starch in arranging the sentences would be at a 
disadvantage. The printed forms of the tests contain so many typographical 
errors resulting in misspelled Latin words that it would be unwise to use 
them without very carefully correcting each copy. 



SUMMARY 



Name 


Scope 


Where Published 


Brown's tests .... 

Hanus' tests 

Henmon's tests. . . 


Vocabulary, trans- 
lation, syntax. 

Vocabulary, trans- 
lation, syntax. 

Vocabulary, trans- 
lation. 


Parker Education Company, 

Madison, Wisconsin. 
School Review, XXIV (May, 

1916), 342-51. 
V. A. C. Henmon, the University 

of Wisconsin, Madison, Wis- 


Lohr's tests 

Starch's tests .... 


Forms. 

Vocabulary, trans- 
lation. 


consin. 
High-School Journal, Chapel Hill, 

North Carolina, for November 

and December, 1918. 
The University Co-operative 

Company, Madison, Wisconsin. 



Note. — In regard to the prices for the above, the Brown tests are not yet listed, and the 
Hanus and Lohr tests are not issued as separate publications. The Henmon tests are listed 
at one cent each. The Starch and Watters tests are sold at fifteen cents per half-dozen copies. 
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The Brown series of tests. — A series of Latin tests was given in the high 
schools of New Hampshire in 1 917 under the direction of Professor H. C. 
Morrison, then state superintendent of public instruction. These tests 
were prepared by President H. A. Brown of the State Normal School, Osh- 
kosh, Wisconsin, by whom a full report of the results of the investigation will 
be issued shortly for free distribution. The series consisted of four parts: 
a vocabulary test, a grammar test, a translation test with detached sentences, 
and a translation test with connected text. These tests will be published 
by the Parker Education Company, Madison, Wisconsin. 



SOME TESTS AND SCALES IN MATHEMATICS 

H. C. Wright 
Algebra 

Coleman's Scale for Testing Ability in Algebra. — This scale consists of a 
series of twenty exercises arranged in order of difficulty. One copy will be 
needed for each pupil. An instruction sheet and an answer card are fur- 
nished. Address Superintendent W. H. Coleman, Crawford, Nebraska. 
Price, 50 cents per package of 50. Package contains one copy of Instru - 
tions to Teachers. 

Hotz's First-Year Algebra Scales. — The Hotz scales comprise two series. 
Series A consists of five tests, one on each of the following topics : (1 ) addition 
and subtraction; (a) multiplication and division; (3) problems; (4) equations 
and formulae; and (5) graphs. Series B does not include graphs but is made 
up of four longer tests, one on each of the other four topics. A full report 
is given in First-Year Algebra Scales by H. G. Hotz. This publication and 
the separate tests may be obtained from the Bureau of Publications, Teachers 
College, Columbia University. One test is required for each pupil. Price 
of any test, except the one on graphs, 50 cents per 100. Price of grap hs, 
70 cents per 100. 

Monroe's Standard Research Tests in Algebra. — This is a series of six tests 
involving multiplication, reduction to a common denominator, division, 
transposition, collecting terms, and solving equations, the topics and their 
treatment being based on the solution of the equations. Standards are 
available for both speed and accuracy. Address Bureau of Co-operative 
Research, Indiana University, Bloomington, Indiana. Price for a set of 
six tests, including directions and record sheets, fi .40 per 100; in quantities 
less than 100, 1 }4 cents each, postage extra. 
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Rugg and Clark's Standardized Tests in First-Year Algebra. — These are 
a series of sixteen tests, each designed to measure skill in a formal operation 
in algebra. The exercises have been very carefully selected and standards 
have been obtained through their use in fifty school systems. Complete 
directions and tabulation sheets are furnished with the test. One set is 
required for each pupil. Price, complete, 4 cents per set. Address H. O. 
Rugg, University of Chicago, Chicago, Illinois. 

Geometry 

Minnick's Geometry Tests. — This series of tests is based on the assump- 
tion that the demonstration of a geometrical theorem involves the following 
abilities: (1) the ability to draw the figure; (2) the ability to state the hypoth- 
esis and conclusion; (3) the ability to recall facts concerning the figure; 
(4) the ability to select and organize facts so as to produce the proof. Address 
J. H. Minnick, University of Pennsylvania, Philadelphia, Pennsylvania. 
Mathematics in General 
Roger's Mathematics Diognostic Tests. — This series consists of the follow- 
ing: (1) a geometry test; (2) two tests in algebraic computations; (3) two 
tests in interpolations; (4) a superposition test. Non-mathematic tests in 
the series are: (1) mixed relations (association) test; and (2) Trabue's Com- 
pletion-Test Language Scales J and L. For a full report on these tests see 
Experimental Tests of Mathematical Ability and Their Prognostic Value by 
Anna L. Rogers. This book together with the separate tests may be obtained 
from the Bureau of Publications, Teachers College, Columbia University. 
One test is required for each pupil. Price, 50 cents per 100; sample set, 
12 cents. 

Other Tests and Scales 

algebra 

Childs, H. G. "The Measurement of Achievement in Algebra," Third 

Indiana Conference on Educational Measurements, II (1917), 171-83. 

Indiana Algebra Tests. Columbia City, Indiana. 
Monroe, W. S. "A Test of the Attainment of First- Year High-School 

Students in Algebra," School Review, XXIII (March, 1915), 159-71. 
Stromquist, C. E. Preliminary Algebra Tests. Laramie, Wyoming. 

GEOMETRY 

Metzler, W. H. "Problems in the Experimental Pedagogy of Geometry," 
Journal of Educational Psychology, III (December, 1912), 545-60. 

Stockard, L. V. and Bell, J. C. "A Preliminary Study of the Measurements 
of Abilities in Geometry," Journal of Educational Psychology, VII 
(December, 1916), 567-80. 
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GRADING MATHEMATICS 

Starch, D. and Elliott, E. C. "Reliability of Grading Work in Mathemat- 
ics," School Review, XXI (April, 1913), 254-59. 

An investigation of a geometry paper written as a final examination 
by a pupil in one of the largest high schools in Wisconsin. Plates of the 
answer paper were made and copies sent to 180 high schools in the 
North Central Association. One hundred and forty papers were re- 
turned. Of these, 128 gave evidence of having been marked with 
unusual care and attention. The results show extreme variability in 
marking. 

A Survey of Measurements 
In "Tests of Mathematical Ability — Their Scope and Significance," 
Mathematics Teacher, June, 1919, Anna L. Rogers has made a critical survey 
of what has been done in measuring pupil abilities in algebra and geometry 
from the inception of the movement in 1914 to date. (See summary sheet 
on pages 806-07.) 



TESTS IN SCIENCE 
Charles J. Pieper 

There are at present no thoroughly standardized science tests on the 
market. Several attempts to establish such standard tests have appeared 
in recent years. Some of these are very general in nature, covering the 
entire field of secondary science. Others are concerned with the measure- 
ment of results in a particular science. The variety of methods used in 
these tests is the best indication that there is no agreement on the important 
question, What shall be the results of a course in secondary science? 

Some of the references given below are included, not because they repre- 
sent standardized tests, but rather because they are suggestive to those who 
may be interested in this phase of education. The bibliography follows the 
order of appearance of the articles or tests. Comments on the nature of the 
tests, or samples of the tests, are given in the bibliography. 

Bibliography 
Starch' s physics test — This is a completion test consisting of 75 mutilated 
sentences covering 102 important facts and principles found in five physics 
texts. Price 2 cents a sheet. University Supply Association, Madison, 
Wisconsin. 

Starch's geography test. — The same as Physics Test, No. 4 in the above 
series. 



8o6 



THE SCHOOL REVIEW 
SUMMARY 



Author 


Title 


Source 


Characteristics 


Cost 


Coleman, W. H... 


Coleman's Scale 


Superinten- 


Twenty exercises ar- 


50 cents per 




for Testing 


dent W. H. 


ranged in order of dif- 


package of 50. 




Ability in Alge- 


Coleman, 


ficulty. 


Package con- 




bra 


Crawford, 
Nebraska. 




tains copy of 
Instructions to 
Teachers. 


Hotz,H.G 


First-Year 


Bureau of 


Two series, A and B. 


50 cents per 100. 




Algebra Scales 


Publications, 


A has 5 tests: (i) ad- 


70 cents per 100 






Teachers 


dition and subtrac- 


for graphs. 






College, 


tion; (2) multiplica- 








Columbia 


tion and division; (3) 








University, 


problems; (4) equa- 








New York. 


tions and formulae; 
(5) graphs. B has 4 
longer tests, one on 
each of above topics 
except graphs. 




Monroe, W. S . . . . 


Standard Re- 


Bureau of Co- 


Six tests: (1) multi- 


$1 .40 per IOO. 




search Tests 


operative 


plication; (2) reduc- 


In quantities 




in Algebra 


Research, 


tion; (3) division; (4) 


less than 100, 






Indiana 


transposition; (5) col- 


1 }4 cents each. 






University, 


lecting terms; (6) 








Bloomington, 


solving equations. 








Indiana. 






Rugg, H. O. and 


Rugg and 


H. O. Rugg, 


Sixteen tests. Each 


4 cents per set. 


Clark, J. R 


Clark's Stan- 


College of 


measures skill in a 


Directions and 




dardized Tests 


Education, 


formal algebraic oper- 


tabulation sheet 




in First-Year 


University of 


ation. Cyclic arrange- 


furnished. 




Algebra 


Chicago. 


ment and time limit 
for each test. 




Minnick, J. H . . . . 


Minnick's 


University of 


Based on the assump- 


Not offered for 




Geometry 


Pennsylvania. 


tion that a geometric 


sale. 




Tests 


Published as a 

Doctor's 

thesis. 


demonstration invol- 
ves 4 abilities: (1) 
to draw the figure; (2) 
to state hypothesis 
and conclusion; (3) to 
recall facts about the 
figure; (4) to select 
and organize facts 
leading to a proof. 






Mathematics 


Bureau of 


Four groups: (1) geo- 


50 cents per 100. 




Diagnostic 


Publications, 


metry test; (2) two 


Sample set, 12 




Tests. 


Teachers 
College, 
Columbia 
University, 
New York. 


tests in algebraic com- 
putations; (3) two 
tests in interpolation; 
(4) superposition test. 
Two non-mathematic 
tests: (1) mixed 
relations (associa- 
tion); (2) Trabue's 
Completion-Test Lan- 
guage Scales J and L. 


cents. 
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Author 



Title 



Source 



Characteristics 



Cost 



Childs.H. G. 



Monroe, W. S. . . 

Stromquist, C. E. 
Metzler.W.H... 



Stockard, L. V. and 
Bell, J. C 



Starch, D. and 
Elliott, E. C... 



Irwin, H. N. 



Thorndike, E. L . 



"The Measure 
ment of 
Achievement in 
Algebra." 



Indiana 

Algebra 

Tests. 

"A Test of the 

Attainment of 

First-Year 

High-School 

Students in 

Algebra." 

Preliminary 

Algebra Tests. 

"Problems in 
the Experimen- 
tal Pedagogy of 
Geometry." 

"A Preliminary 
Study of the 
Measurements 
of Abilities in 
Geometry." 
"Reliability of 
GradingWork in 
Mathematics." 



"A Preliminary 
Attempt to 
Devise a Test 
of the Ability of 
High-School 
Pupils in the 
Mental Manip- 
ulation of 
Space Rela- 
tions." 

"An Experi- 
ment in Grad- 
ing Problems in 
Algebra." 



Third Indiana 
Conference on 
Educational 
Measure- 
ments, II 
(1917). I 7 I ~ 
83- 

The author, 
Columbia 
City, Indiana. 
School Review, 
XXIII 
(March, 
1 91 5), 159-71. 



The author, 
Laramie, 
Wyoming. 
Journal of Ed- 
ucational Psy- 
chology, III 
(December, 
19"). 545-6o. 
Journal of 
Educational 
Psychology, 
VII (December 
1916), 567-80. 
School Review, 
XXI (April 
I9I3). 254-59- 



School Review. 
XXVI (Octo- 
ber, Novem- 
ber, Decern 
ber, 1918), 
600-5, 6 54~ 
70, 759-72. 



Mathematics 
Teacher, VI 
(March, 1914) 
I23-34- 



An investigation of a 
geometry paper writ- 
ten as a final examina- 
tion by a pupil in one 
of the largest high 
schools in Wisconsin. 
Material not strictly 
geometrical, but 
classification of errors 
of interest to 
geometry teachers. 



Problems arranged 
according to their dif- 
ficulty as expressed 
by the judgment of 
two hundred teachers 
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A test in mechanics. — This test devised by Randall, Chapman, and 
Sutton consists of fourteen problems in mechanics ranging from easy to very 
difficult, involving but little mathematics. The test may be found in an 
article entitled "The Place of the Numerical Problem in High-School 
Physics," School Review, XXVI (January, 1918), 39-43. 

Jones's union science tests. — The Jones's tests are made up principally of 
numerical problems involving a knowledge of the principles of physics or 
chemistry. They may be obtained from F. T. Jones, 10109 Wilbur 
Avenue, Cleveland, Ohio. 

The Gary survey tests. — The Gary tests were prepared by O. W. Caldwell 
for use in the survey of science instruction in the Gary public schools. They 
are designed to measure observation, discrimination, recall, and the use of 
information and reasoning in science problems. They may be found in the 
volume entitled The Gary Public Schools: Science Teaching, by Mr. Caldwell, 
published by the General Education Board, 61 Broadway, New York City. 

A range of information test in biology. — This test by N. M. Grier is much 
like Dr. Downing's test referred to below, but uses one hundred terms from 
biology. It may be found in an article by Mr. Grier entitled "The Range of 
Information Test in Biology I. Physiology," Journal of Educational 
Psychology, IX (April, 1918), 210-16. 

A test in first-year chemistry. — This is a twenty-five-question test given 
to seventeen Texas city schools. The results permit valuable comparisons 
of schools, standardization of questions, and the ranking of individual 
pupils. The test is reported by J. Carleton Bell under the title, "A Test in 
First-Year Chemistry," in the Journal of Educational Psychology, IX (April, 
1918), 199-210. It is very suggestive and will lead the way to more care- 
fully controlled tests of a similar but more extensive kind. 

Preliminary test in chemistry. — This test represents a study of test sheets 
used with classes in chemistry in determining differences between mixture, 
compound, and element. Results are given in a scale showing order of 
difficulty in classifying many common substances and materials. Definite 
suggestions for modification of instruction are added. This is a valuable 
study on one small phase of high-school chemistry, but is not a standardized 
test. It is published by H. A. Webb under the title, "A Preliminary Test in 
Chemistry," in the Journal of Educational Psychology, X (January, 1919), 
3 6 -44- 

A range of information test in science. — This is a preliminary attempt to 
measure results of science instruction by testing pupils' acquaintance with 
general notions. E. R. Downing, "A Range of Information Test in Science," 
School Science and Mathematics, XIX (March, 1919), 228-33. 
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TESTS IN HOME ECONOMICS 
Rosa Biery 
Informational and reasoning tests in textiles and clothing. — These tests 
have been constructed by Leona F. Bowman and Mabel Trilling of the 
University of Chicago, and will be described in a forthcoming number of the 
Supplementary Educational Monographs published by the School of Educa- 
tion, University of Chicago. The tests are as yet tentative, but are being 
reorganized for purposes of standardization. The monograph will also 
include an analysis of the textbooks which materially influence the teaching 
of clothing, shelter, and foods, and an analysis of courses of study of seventy- 
six representative cities. 

A scale for measuring skill in machine sewing. — This scale has been pre- 
pared by Florence Williams and Clara Knapp, formerly of the University 
of Chicago. The plan followed in making this scale is similar to that used 
by Thorndike in preparing his handwriting scale. A discussion of it will be 
found in the monograph mentioned above. The scale will be on sale in a 
few months. 

A scale for measuring certain elements in hand sewing. — This scale was 
designed by Katherine Murdock, Columbia University, and is for sale by the 
Bureau of Publications, Teachers College, Columbia University, New 
York City. 



II. CURRENT PUBLICATIONS RECEIVED 
DURING THE PAST MONTH 

A. GENERAL EDUCATIONAL METHOD, HISTORY, 
THEORY, AND PRACTICE 

Betelle, James O. Checking Schedule for Projected School Buildings. 

Milwaukee, Wisconsin: Bruce Publishing Co., 1919. Pp. 32. 
Chancellor, William Estabrook. The Health of the Teacher. Chicago: 

Forbes & Co., 1919. Pp. ix+307. $1.25. 
Courtis, Stuart A. The Gary Public Schools: Measurement of Classroom 

Products. New York: General Education Board, 191 9. Pp. xxii+532. 

$0.30. 
Dooley, William H. Principles and Methods of Industrial Education. 

Boston: Houghton MifRin Co., 1919. Pp. xi+257. $1.60. 
Winship, A. E. Danger Signals for Teachers. Chicago: Forbes & Co., 

1919. Pp. xi+204. $1.25. 



